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We consider a model of a decentralized multiple access system with a non-standard binary 

feedback where the empty and collision situations cannot be distinguished. We show that, 

*y* | like in the case of a ternary feedback, for any input rate A < e" 1 , there exists a "doubly 

randomized" adaptive transmission protocol which stabilizes the behavior of the system. We 

_5 . discuss also a number of related problems and formulate some hypotheses. 
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^D ■ 1 Introduction 

CN ■ 

We consider a decentralised multiple access system model with an infinite number of users, 
a single transmission channel, and an adaptive transmission protocol that does not use the 
individual history of messages. With any such a protocol, all users transmit their messages in 
time slot (n, n + 1) with equal probabilities p n that depend on the history of feedback from the 
£> ' transmission channel. 

^ Algorithms with ternary feedback "Empty-Success-Collision" were introduced in [13] and [2]. It 

is assumed that the users can observe the channel output and distinguish among three possible 
situations: either no transmission ("Empty") or transmission from a single server ("Success") or 
a collision of messages from two or more users ("Conflict"). It is known since the 80's (see e.g. 
[5], [9]) that if the feedback is ternary, then the channel capacity is e _1 : if the input rate is below 
e _1 , then there is a stable transmission protocol; and if the input rate is above e _1 , then any 
transmission protocol is unstable. A stable protocol may be constructed recursively as follows: 
given probability p n in time slot (n, n + 1) and a feedback at time n + 1, probability p n +i is bigger 
than p n if the slot (n, n+ 1) was empty, p n +i = Pn if there was a successful transmission, and p n +i 
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is smaller than p n if there is a conflict. Hajek [5j considered a multiplicative increase/decrease, 
and Mihajlov [9] an additive one. 

It is also known, see e.g. [7] and [10] that similar results (existence/nonexistence of a stable 
protocol if the input rate is below/above e~ 1 ) hold for systems with either "Empty-Nonempty" 
binary feedback or "Confhct-Noncoflict" feedback. 

In this paper we show that the channel capacity is again e~ x for a third type of the binary 
feedback, "success-failure" feedback, which might also be called "success-nonsuccess" feedback. 
The problem is interesting from a practical point of view, because in order for a receiver to 
distinguish between "collision" and "no transmission", it would have to differentiate between 
the increased energy or structure present when there is a collision of two or more packets, from 
thermal noise. That can be difficult or impossible for some receivers to do. 

Tsybakov and Beloyarov, [11] and [12], introduced and studied a model with the "success-failure" 
feedback, but with an extra option. There is a selected in advance station which works as follows. 
Given a nonsuccess feedback, the station may send, in the next time slot, a testing package to 
recognize what has happened, either empty slot or or collision. Clearly, if an algorithm uses 
this option regularly, it is an algorithm with the ternary feedback which works slower that the 
conventional one (uses two time slots instead of one in the case of nonsuccess) . In [11] and |12] , 
the authors introduce a class of algorithms that send a testing package from time to time only 
and show (numerically) that the lower is the rate of using this option, the closer to e _1 is the 
throughput. 

In this paper, we do not allow testing of packaged. Our approach to the problem is to introduce 
a further (second) randomization. We consider a new class of "doubly randomised" protocols 
and show that, for any pair of numbers < Ai < Ao < e , there exists a protocol from the 
class that makes stable a system with input rate A, for any AG [Ai, Ao]. Then we formulate two 
conjectures on stability of other classes of protocols and, in particular of protocols that do not 
depend on an actual value of A. Our stability result is based on a generalized Foster criterion 
and the fluid approximation approach, see e.g. [3J. 

In a recent paper [15] (see also [6]), a stability result has been obtained for a similar model with 
"success-failure" feedback where a user may also take into account the arrival time of its message. 
It was shown that if the input rate is below 0, 317, then there exist stable algorithms (called 
"algorithms with delayed intervals"). The results of our paper are stronger in two directions: 
we show that a stable protocol exists if the input rate is below e _1 (clearly, e _1 > 0.317) and 
that there is no need to use the information about arrival times. 

There is an interesting question which seems to be open: assume we know arrival times of 
messages. Could this extra information increase an actual channel capacity? 

The paper is organised as follows. Section 2 contains the description of the model and of the 
class of transmission protocols under consideration, as well as the statement of the main result. 
Its proof is presented in Section 3. Then in Section 4 we introduce two more classes of protocols 
and formulate conjectures on their stability. 

2 The Model and the Class of Protocols 

We consider (a variant of) a multi-access system introduced in [J3]. There is an infinite number 
of users and a single transmission channel available to all of them. Users exchange their messages 



using the channel. Time is slotted and all message lengths are assumed to be equal to the slot 
length (and equal to one). 

The input process of messages {£ n } is assumed to be i.i.d. with finite mean A = E£i, here £ n 
is a total number of messages arriving within time slot [n,n + 1) (we call it "time slot n", for 
short). 

The systems operates according to an "adaptive ALOHA protocol" that may be described as 
follows. There is no coordination between the users, and at the beginning of time slot n each 
message present in the system is sent to the channel with probability p n , independently of 
everything else. So given that the total number of messages is N n , the number of those sent to 
the channel, B n , has conditionally the Binomial distribution B(N n ,p n ) (here B n = if N n = 0). 
Let J n = 1 if B n = 1 and J n = 0, otherwise. If J n = 1, then there is a successful transmission 
within time slot n. Otherwise there is either an empty slot (B n = 0) or a collision of messages 
(B n > 2), so there is no transmission. Then the following recursion holds: 

N n+1 = N n -J n + £ n+1 . (1) 

A transmission protocol is determined by sequence {p n }- We consider "decentralised" protocols: 
the numbers N n , n = 1,2,... are not observable, and only values of past J&, k < n are known. 
We consider protocols where {p n } are defined recursively in the Markovian fashion: p n is a 
(random) number that depends on the history of the system only through p n -\ and J n -i- Then 
a 2-dimensional sequence (N n ,p n ), n = 1, 2, . . . forms a time-homogeneous Markov chain. 

In the paper, we introduce three classes of decentralised protocols, prove a stability theorem for 
the first class and conjecture similar results for the two others. To describe these protocols, we 
introduce additional notation. 

Let N\ > be the initial number of messages in the system and S\ > 1 a positive number (which 
is an "estimator" of unknown Si). Let further /3 E (0, 1), C > and D > be three positive 
parameters, and let {I n } be an i.i.d. sequence that does not depend on the previous r.v.'s, with 
P(J„ = 1) = 1 - P(I n = 0) = 1/2. 

Remark 1. In what follows, one can assume a sequence of estimators {S n } to take integer values 
only, by assuming that D and C are integer- valued. But this is not needed, in general. 

The class A\ of algorithms is determined by (3, C > 0, D > 0, {J n } and {/„} as follows. The 
transmission probabilities p n and the numbers S n are updated recursively: given S n , we let 

Pn = 

and then 

' S n + C 

S n +\ = \ S n + CD 

max(S' n — 

We denote such an algorithm by A\(C, D, (3) G A\. 

The two other classes are defined in Section [U 

We can see that, with any algorithm introduced above, sequence {(N n ,S n )} forms a time- 
homogeneous Markov chain. 



P/Sn 


if In = 0, 






l/5„ 


if /„ = 1, 

if Jn = 0, 








if Jn = 1 


and I n 


= o, 


7£>,1) 


if Jn = l 


and I n 


= 1. 



Definition 1. We say that a Markov chain {(N n , S n )} is positive recurrent if there exists a 
compact set K E 1Z 2 + such that 

• for any pair of initial values (N\, S±) = (N, S), 

tn,s = min{n > 1 : (N n , S n ) € /C} < oo a.s. 

• further, 

sup Etn,s < °o. 

(N,S)eK. 

A Markov chain {(N n ,S n )} is Harris- erg odic if there is a probability distribution jjl such that, 
for any initial value (Ni,Si) = (N,S), the distributions of (N n ,S n ) converge to [i in the total 
variation, 

8up\P((N n ,S n )eA)-ii(A)\->0, n-S-oo (2) 

A 

where the supremum is taken over all Borel sets A in TZ^_. 

It is well-known (see e.g. [8]) that a positive recurrent Markov chain {(N n , S n )} is Harris-ergodic 
if it is aperiodic and there exist a positive integer to, a probability measure (p, and a positive 
number c such that 

P((JV m , S m ) e ■ | (iVi, S n ) = (N, S)) > apt), (3) 

for all (N, S) G K. 

Definition 2. We say that Markov chain {(N n ,S n )} is transient if there is an initial value 

(iVi, Si) = (N, S) such that N n + S n — > c» a.s., as n — > oo. 

Definition 3. Algorithm j4 is stable if the underlying Markov chain (N n , S n ) determined by A 

is Harris-ergodic, and unstable if the underlying Markov chain is transient. 

Here is our main result. 

Theorem 1. Let < Ai < Ao < e _1 be any two numbers. There exist C > 0, fi\ £ (0, 1) 
such that, for any fixed /3 & (/?i, 1), there exists Dq = Dq(Xq, Ai, 0) such that, for any D > Dq, 
algorithm Ai(C,D,j3) is stable for any input rate A G (Ao, Ai). 

3 Proof of Theorem 1 

We need to introduce a number of auxiliary functions: for positive numbers /3, A, C, D and for 
< z < oo, let 

Ji(z,P) = fje-P', J2(z) = Z -e~ z - (4) 

j(z,0) = ji(z,(3)+j 2 (z); (5) 

a(z,/3) = X-j(z,(3); (6) 

b(z,/3) = C(l-j(z,f3)) + CD(ji(z,(3)-j 2 (z)); (7) 

r(z,/3) = a{z,P)-zb{z,P). (8) 

Cleary, for any /3 > and asz-> oo, ji(z, /3), j 2 (z) and j(z,(3) tend to 0, a(z,/3) — > A, b(z,f3) — > 

C, and r(z,P) — > — oo. 

We rely on the following auxiliary result. 



Lemma 1. The functions j (z) , a{z) , b(z) and r(z) satisfy the following conditions: 

for any < Ao < Ai < e~ l , there exists fi\ G (0, 1) such that, for any A G (Ao, Ai) ; /3 G (/3i, 1) 

and for any C >C\ := j-f-^n and Z) > D(C) (where D(C) is specified in the proof), 

• equation a(z) = /ias £u>o roots < zi < Z2 < oo; 

• equation b(z) = /ias two roots < £i < £2 < oo; 

• < ti < zi < £2 < ^2; 

• r(z) > /or z G (0, £1) and r(z) < for z > z<i and, therefore, all roots to equation 
r(z) = lie in the interval (21, £2). 

Proof. Introduce a further function 

6i(z,0) = l-j(z,(3)+D(j 1 (z,(3)-j 2 (z,f3)). 

Then &(*, /3) = Coi(z,/3). 

We know that ze _2: (and also J2(z)) is increasing in z if z G (0, 1) and decreasing if z > 1. 
Then, for /3 < 1, ji(z,(3) is increasing if z < 1//3 and decreasing if z > 1//3. Further, m,(/3) := 
min. 1<z<1 /pj(z, P) is strictly positive and tend to 1 as ft 1 1- 

For any Ai G (0, e" 1 ) and any e G (0, e" 1 — Ai), one can choose j3\ < 1 so close to 1 that 
m(/3) > Ai + e, for all j3 G [/3i,l). Then for any A G (0, Ai] and any/3 G [/3i,l), equation 
j(z,/3) = A has two roots, zi(/3,A) and Z2(/3,A), with 

ziW, A) < zx(/3, Ai) < 1< z 2 (/3, A 2 ) < z 2 (/3, A). 

By continuity of functions under consideration, for any A < Ai, /3z2(/3, A) — >• £2(1, A) as /3 t 1, so 
one can choose j3\ G \fi\, 1) such that 

inf inf /3z 2 (/3,A) > 1. 

A6(0,Ai]/36[ft,l] 
Then, again for all A G (0, Ai] and all /3 G [/3i, 1], 

ii(zi) - i 2 (^i) < < ji(z 2 ) - j 2 (z 2 ), (9) 

with Zj = Zj(/3, A), for i = 1, 2. 

Now we fix j3 G [/3i, 1) and, for given < Ao < Ai, let 

2 

A) = — f 1- ( \ — —r-\\ < °°- ( 10 ) 

mi a <a<Ax (.72(^1) - Jl(^l)) 

Then, for any D > Dq and for any A G [Ao,Ai], we have b\ (zi) < and b\(z2) > (the latter 

inequality always holds). 

Take any D > Dq and let t\ < £2 be the roots to equation b\ (z) = (one can easily show that 

the latter equation has exactly two roots). Then, clearly, < £1 < z\ < £2 < Z2. 

Further, we may choose C such that all roots of equation r(z) = lie in the interval (zi,£2). 

Indeed, for z > Z2 > 1 and A < Ai, 

r(z) = \-j( z )-Cz(l-j(z))-CDz(j 1 (z)-j 2 (z)) 
< X 1 -C{l-e- 1 )<-l 



c >- c > - ttfi- (11) 

Further, for z < t\ < 1 and A > Ao, 

r(z) > A-j(z)-Cz(l-.7(z)) 

> A-j(ti)-Cti 

> A -(1 + C)ti 

since j'(ti) < tie - ' 1 < ii. The value of t\ is decreasing to as D tends to infinity. Therefore, 
one can choose D\ = D\(C) such that (1 + C)t\ < \q/2 for any D > D\, and then let D(C) = 
max(Do,-Di)- 

In more detail, since sup^^ J2 \^ 3 }f llyt ) < °° for any < t < 1 and since lim^o j 2 \i)-jl(t) = °°' 
we may choose D\ = D\(C) so large that 

t{D 1 ) = max{i G (0, 1) : .)~ 3 V,.. > A} 

satisfies inequality i(-Di) < 2(0+1) ' Therefore, for any D > L>i, we have t\ < t(D\) < 2 tc°+i) • 

It is left to comment that r(z) > for z G (£1, z\] since a(z) > and b(z) < 0, and that r(z) < 

for z G [t2j 22) since a(z) < and 6(z) > 0. 

The proof of the lemma is complete. 

Now we apply the lemma to the proof of Theorem 1 as follows. 

Step 1. We introduce fluid limits for the Markov chain under consideration. Let Markov Chain 

(N™°,Sfc ) start from initial values No = mo, So = so and assume that v := mo + «o -> 00 

and that ttiq/v — > x,so/v — > y where x + y = 1. Consider a continuous time Markov process 

(N n (t),S s (t)) where 

N"(t)=N$ v] , S s (t) = Sf tv] 

and [z] is an integer part of number z. Then we consider a family of weak limits of these 
processes, as v — > 00. By following the standard scheme (see, e.g., |3j, |lj), one can easily show 
that each such a limit, say (N(t),S(t)) is a Lipschitz function with continuous derivatives, and 
the derivatives are the functions a(z) and b(z) that were introduced earlier. 

To see that the derivatives are a{z) and b(z) indeed, we may find the one-step drift. We have 

j(m,s) := E(J n I N n = m, S n = s) = ^ (l - ?Y +%-(l-^' 

2s \ sj Is \ s t 

Then 

a(m, s) := ~E(N n+1 - N n \ N n = m, S n = s) = A - j(m, s). 

In the conditions of Theorem [TJ and for s > CD, 

b(m,s) := E(S n+ i-S n \N n =m,S n = ys) = C(l-j(m,s))+CD I -£ (l - ^J - — (l - - 

Then, as m + s — > 00, m/s — > z, 

j(m,s) — >■ j(z), a(m, s) —$■ a(z) , b(m, s) — >• b(z) . 



Step 2. We show next that any fluid limit (N(t),S(t)) is stable in the following sense: for any 
e G (0, 1), there exists finite time t £ such that N(t £ ) + S(t e ) < 1 — e. 

Then, by the general theory (see e.g. pQ), the positive recurrence of the underlying Markov 
chains follows. 

Below we introduce a positive function R(z) with R(0) = 1 and show that the pair (arctan(z) , R(z)) , 
< z < oo is a smooth function whose graph splits the positive quadrant into two domains 
(where one of the domains is a convex compact neighbourhood of the origin) with vector 
(a(z),b(z)) being directed into the compact domain, and its normal component to the line 
is not smaller than a certain positive value. 

The proof follows a number of routine steps, therefore we provide a sketch of the proof only. 

First we construct a piecewise-linear function. Then we make it smooth around points where 
the line changes it direction. 

Then, for any constant c > 0, we draw a line (arctan(z),cR(z)), and introduce a test function 
L{x,y) by letting L(x,y) = c if the point (x,y) belongs the line (arctan(z),cR(z)). 

We now introduce a piecewise linear function. We start from (xo,0) with xq = 1 and draw a 
line L at an angle from the absciss which is smaller than angle ipo = arctan(C / X) (which is the 
direction of the derivative of the fluid limit at this point) by an angle a with tangent e « 1. 
We assume that the ratio K := (it/2 — (fo)/a is an integer. 

Now we find < Z\ < . . . < z^ such that b(zi)/a(zi) = tan(ipo + ia) and draw the lines k that 
start from the origin in the direction arctan(zi). Let (xi,z±xi) be the point of the intersection 
of the lines L and l\. Starting from this point, we continue L in an angle <po, until it crosses 
the line li at point (x2, Zix-i)- Then we continue L under angle ipo + a until it intersects 1%, and 
so on. When L meets In (at point xn,znxn)), it continues under the angle n/2 — a until the 
intersection with the line y = x (which starts from the origin under angle 7r/4). Assume the 
intersection point is (x' 1 ', z^ 1 - 1 ). 

Now we start from (0, yo) with yo = 1 and draw another piecewise linear line in the upper half- 
quarter of the positive quadrant using similar arguments. Assume it intersects the line y = x at 
point (x^ 2 > ,x^ 2 >). If we start instead from (0, (2 ^° ) , then the two lines meet at point (x' 1 ^, x^ 1 '). 
The two lines divide the positive quadrant into two domains, and the compact domain is convex. 
The combined line is piecewise linear. We can make it "smooth" by local changes in the turn 
points. This completes a construction of the line L(x,y) = 1. 

All other lines L(x, y) = c are obtained by the scaling. Then, for c large enough, the line 
L(x, y) = c is rectifiable. Then, using routine calculations, one can show that, at each point of 
the line, the drift vector is directed into the compact domain, and its normal projection is always 
positive (which means that its minimal value is still positive, due to continuity and boundedness 
of the line). This completes the proof of the theorem. 

4 Conjectures 

Here we introduce two more classes of transmission protocols and conjecture corresponding 
stability results. 

Let T-L be a class of functions h : [1, 00) — > [0, 00) such that h(l) = 0, h(x) f 00 is non-decreasing 
in x, x — h{x) t 00 is non-decreasing in x, and h(x)/x — > 0, as x — > 00. With each h G Ti, 



we associate a class Eh of positive functions Eh : [1, oo) — > (0,1/2], such that £h{x) — > and 

h(x)e 2 {x) — > oo, as x — > oo. 

The two other classes of algorithms differ from the first class in the following. 

Algorithms from the second class A2 differ from those from the class A\ only in a way the >S"s 

are updated: the constant CD is replaced by a function h & T-L. More precisely, the algorithms 

are determined by /3, C, h(x), {J n } and {I n }- Given S n , we again let 

j(3/S n if I n = 0, 



Pr. 



1/S n if I n = 1, 



but now define S n +i by 



S n + C if J n = 0, 

S n +i = < S n + h(S n ) if J n = 1 and I n = 0, 

max(5 n — h(S n ), 1) if J ra = 1 and I n = 1. 

For this algorithm, we use notation ^12 (C 5 ^ 5 /3) £ -4.2- 

We modify further the class 2 algorithms by replacing /3 by 1 — e^, this will form the third class 
.4.3. More precisely, the algorithms are determined by C, h, Eh, {Jn} an d {In}- Given S n , we 
now let 

\(l-Sh{Sn))/S n if / n = 0, 
Pn = < , 

\l/5 n if / n = l, 

and then define S^+i as for class 2 algorithms: 

's n + c if J n = 0, 

S'n+i = < S n + ^(S'n) if J ra = 1 and J n = 0, 

max(5 n — h(S n ), 1) if J n = 1 and I n = 1. 
For this algorithm, we use notation ^(C, h, 1 — e^) € ^3. 

We can see that again, with any algorithm from the classes A2 or ^3, a sequence {(N n ,S n )} 
forms a time-homogeneous Markov chain. 
We believe that the following two statement should be true. 

Conjecture 1. Let < Ao < e _1 be any number. There exists C > and $2 £ (0, 1) such that, 
with any (3 G (02, 1) and any function h £ "H, algorithm A2(C,h,(3) stabilizes the system, for 
any input rate A < Ao- 

If, on the contrary, either /3 < /?2 or A > Ao , then the algorithm ^(C, h, (3) is unstable in the 
system with input rate A, for any h £ Ti. 

Conjecture 2. Any algorithm A%(C, h, 1 — £h) from the third class stabilizes the system, for 
any input rate A < e -1 . 

Remark 2. The conjectures may hold for a broader classes of algorithms if one assumes that, in 
the recursion for S n , function h is replaced by two functions, hi in the second line and /12 in the 
third line. 



Acknowledgement. The authors (Foss and Hajek) thank the SCS programme at the Newton 
institute of Mathematical Studies, Cambridge, UK and (Foss and Turlikov) the RS International 
Collaboration Grant 2009/R4. 



References 

[1] M. Bramson. Stability of queueing networks Lecture Notes in Mathematics, 1950. Berlin: 
Springer, 2008. 

[2] J. L. Capetanakis. Tree algorithms for packet broadcast channels. IEEE Transactions on 
Information Theory, 25(5):505-515, 1979. 

[3] J. G. Dai. On positive Harris recurrence of multiclass queueing networks: a unified approach 
via fluid limit models. Annals of Applied Probability, 5:49-77, 1995. 

[4] S. Foss, T. Konstantopoulos. An overview of some stochastic stability methods. Journal of 
Operation Research Society Japan, 47(4):275-303, 2004. 

[5] B. Hajek and T. van Loon. Decentralized dynamic control of a multiaccess broadcast 
channel. IEEE Trans. Automatic Control, 27(3), 559 - 569, 1982. 

[6] A. Malkov, A. Turlikov. Random multiple access protocols for communication systems 
with " success- failure" feedback. IEEE International Workshop on Information Theory, 
1:39, 1995. 

[7] N. Mehravari, T. Berger. Poisson multiple-access contention with binary feedback. IEEE 
Transactions on Information Theory, 30(5):745-751, 1984. 

[8] S. Meyn and R.L. Tweedie. Markov Chains: Stochastic Stability. Springer, 1993. 

[9] V.A. Mihajlov. Geometrical Analysis of the Stability of Markov Chains in R™ and Its 
Application to Throughput Evaluation of the Adaptive Random Multiple Access Algorithm. 
Problems of Information Transmission, 24(1): 47-56, 1988. 

[10] B. Paris, B. Aazhang. Near-optimum control of multiple-access collision channels. IEEE 
Transactions on Wireless Communications, 40:1298-1308, 1992. 

[11] B.S. Tsybakov, A.N. Beloyarov. Random multiple access in a channel with a binary feedback 
"Success-Failure". Problems of Information Transmission, 26(3):67-82, 1990. 

[12] B.S. Tsybakov, A.N. Beloyarov. Random multiple access in a channel with a binary feed- 
back. Problems of Information Transmission, 26(4):83-97, 1990. 

[13] B.S. Tsybakov, V.A. Mihajlov. Free synchronized access in a broadcast channel with a 
feedback. Problems of Information Transmission, 14(4):32— 59, 1978. 

[14] B.S. Tsybakov, V.A. Mihajlov. Random multicle access of packets. Splitting algorithm. 
Problems of Information Transmission, 16(4):65-79, 1980. 

[15] A. Turlikov and S. Foss. On ergodic algorithms in random multiple access systems with 
"success-failure" feedback. Problems of Information Transmission, 46(2):185-201, 2010. 



